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© A medical image storage system includes a 
method of displaying (114), in real time motion. 



medical images recorded on a transportable medium 
(100) as lossless compressed medical image data. 
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This invention relates in general to a medical 
image storage system. This invention relates in 
particular to a method of displaying in real time 
motion medical images recorded on a transportable 
medium as lossless compressed medical image 
data. 

In traditional film screen radiography, an x-ray 
image of an object, such as an anatomical part of a 
patient, is formed in film. The film is then pro- 
cessed to produce a developed x-ray film image. 
Storage of and/or display of multiple x-ray film 
images from a patient study is space intensive, 
inconvenient and expensive. With the advent of 
digital image diagnostic scanner equipment, such 
as CT and MRI scanners, digital radiographic im- 
ages have become commonplace. Digital images 
have several advantages over film images. They 
can be stored in compact magnetic or optical me- 
dia. They can be displayed on a display device, 
such as a video monitor. They can also be pro- 
cessed to optimize various characteristics of the 
digital radiographic image. 

Digital radiographic images can also be pro- 
duced by means of computed radiography tech- 
niques. The following U.S. patents disclose the 
storage in an optical disk media of digital images 
produced by computed radiography: US-A- 
4,768.099; US-A-5,001 ,569; US-A-5,01 9.975. It is 
disclosed in these patents that the image signals 
recorded on the optical disk are subjected to an 
image compression technique before recording. 
There is no disclosure in these patents, however, of 
recording both lossy and lossless radiographic im- 
ages on the same optical disk. US-A-5,01 5,854, 
discloses a radiation image display apparatus hav- 
ing a magnetic hard drive which stores both un- 
compressed image signals and a condensed image 
signal which represents an outline of the uncom- 
pressed radiation image. There is no disclosure in 
this patent, however, of storing the uncompressed 
and compressed radiation image signals on a re- 
cordable optical compact disk. 

Cardiac x-ray angiography with the aid of x-ray 
absorbing contrast media, images the arteries 
which supply blood to the heart muscle tissue. 
Restrictions in blood flow (stenoses) cause insuffi- 
cient blood supply and hence oxygen deprivation 
of the muscle tissue. The partial lack of oxygen will 
cause chest pain (angina), while a nearly total lack 
of blood flow will cause a heart attack (myocardial 
infarction) during which the muscle tissue dies and 
the performance of the heart either diminishes or 
ceases to function and the individual dies. Since 
the arteries of interest wrap around the outside of 
the heart, and the heart is constantly in motion, to 
adequately image these vessels the x-ray exposure 
and image capture must be obtained from nu- 
merous anatomical projections and be captured 



with real time motion imaging (approximately 
30. images per second) at high spatial resolutions. 
All of this leads to large amounts of digital data. An 
average diagnostic procedure is 2000 images. De- 

5 pending upon the image acquisition matrix, the 
average procedure generates between 500 
Megabytes (MB) and 2 Gigabytes (GB) of digital 
data. Imaging during an interventional procedure 
can cause the amount of digital data to double. 

w The most common method today to record 

cardiac catheterization images are in analog form 
on specialized 35 mm black and white cine film. 
However, there is a strong desire to archive the 
digitally generated images on a cost effective me- 

;5 dium as the official record of the procedure and for 
future review as well. To use digital storage media 
more efficiently, the data can be mathematically 
compressed in a way that is totally reversible (los- 
sless compression). To subsequently view the im- 

20 ages, the clinician needs to see the images in real 
time motion and at slower speeds as well. The 
clinician also wants to randomly access rather than 
just sequentially access the images. Presently, 
there is no digital archive medium which can meet 

25 the following requirements: data transfer rates fast 
enough to provide real time motion display of los- 
slessly compressed images and random data ac- 
cess. Therefore, the only available options to pro- 
vide random access and real time motion display 

30 are. either to transfer the data from a slower in- 
expensive archive medium onto a faster more ex- 
pensive buffer medium, or to have stored the data 
at a higher lossy compression so that the data 
transfer rate of the inexpensive archive medium is 

35 fast enough to support real time motion display. 

Clinicians have expressed a strong preference 
to avoid the required delay time while the digital 
data is transferred from the archive medium to the 
fast buffer medium. Eigen (Nevada City, CA) irttro- 

40 duced a product which stores the digital cardiac 
image data on a magneto-optical disk in two forms. 
One form is a lossless compression, the other is a 
lossy compression which supports higher speed 
motion display. The Eigen review product allows 

45 the clinician to review images in motion utilizing the 
lossy compressed data and if the user stops for a 
still image the lossless compression data corre- 
sponding to the still image will be utilized. 

Often patients having this procedure are re- 

50 ferred to different medical institutions, and the im- 
age record of the procedure must be sent to the 
referral facility. The digital image data in most 
cases will be sent as a 2:1 lossless compression of 
data. If the referral institution has a networked 

55 image review system, the data can be transferred 
(uploaded) to the network's disk array and the 
clinician can review the images with the required 
real time motion. However, if the referral center 
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does not have this capability, then they have two 
options. They can view the images immediately at 
a much slower maximum display speed (perhaps 5 
frames per second or less), limited by the maxi- 
mum rate that the lossless data can be transferred 
from the exchange medium that the data was sent 
on. The other option is to purchase a disk array 
and upload the data from the exchange medium 
onto the disk array. Once the data is on the disk 
array, the user can view the images in real time 
motion. Adding a suitably sized disk array can be 
expensive, that is, several thousand dollars. 

Using a magneto-optical disk to archive the 
images as a replacement for cine film has two 
distinct disadvantages, however. Firstly, cine film is 
an unalterable record of the procedure, whereas a 
magneto-optical disk is a re-writable medium per- 
mitting intentional or accidental changes to the 
permanent record of the procedure. Secondly, 
magneto-optical media violates the desire for a 
cost effective replacement for cine film. To archive 
an average procedure on a magneto-optical disk 
will cost about three times more than archiving the 
images on cine film. 

US-A-4,768,099, discloses a system where raw 
image data from an X-ray imaging system is di- 
rectly recorded on an optical disk with image pro- 
cessing conditions. The recorded image data may 
be compressed before recording. US-A-4.969.049. 
discloses a system where image data supplied by 
an interface means is compressed and recorded on 
an optical disk along with retrieval data from a 
memory module. Neither patent discloses a solu- 
tion to the problem of providing substantially real 
time viewing of lossless compressed motion medi- 
cal images. 

According to the present invention, there is 
provided a solution to the problems of the prior art. 
According to an aspect of the present invention 
there is provided a method of displaying in real 
time motion medical images recorded on a trans- 
portable medium as lossless compressed medical 
image data, comprising: 

reading lossless compressed medical image 
data from a transportable medium upon which it is 
recorded: 

decompressing the lossless compressed medi- 
cal image data to produce decompressed medical 
image data; 

lossy compressing the decompressed medical 
image data to produce lossy compressed medical 
image data: 

storing the lossy compressed medical image 
data on an inexpensive magnetic hard drive; and 

displaying the medical images represented by 
said lossy compressed medical images in real time 
motion on a display. 

The invention has the following advantages: 



a) An inexpensive way to view digital images 
from an outside medium source which has 
slower data transfer rates than required for a 
desired viewing speed. 

5 b) Since the lossy compressed images are 

stored on an inexpensive hard disk, the com- 
pressed image data can be subsequently stored 
on either the original data source medium or 
onto a new medium. This would allow the data 

w to be viewed next time without time delay for 
the upload/decom pre ss/recom press process, 
c) No additional time penalty is incurred, since it 
would take the same time to upload lossless 
data to an expensive disk array as it takes to 

j s create the lossy data and to store it on an 
inexpensive hard magnetic drive. 
Fig. 1 is a block diagram of a medical image 
archiving and review system; 
Fig. 2 is a diagrammatic view of an embodiment 

20 of record once compact disk: 

Fig. 3 is a block diagram of an archiving station 
of the system of Fig. 1 : 

Fig. 4 is a block diagram of a review station of 
the system of Fig. 1 ; and 
25 Fig. 5 is block diagram of a computer based 
system which can be used in carrying out the 
present invention. 
A technique has been proposed for recording 
medical images, and, more particularly, x-ray cardi- 
30 ology angiography images on a recordable optical 
compact disk. The recorded image data is com- 
pressed in two different ways: one is a lossy or 
irreversible compression and the other is a lossless 
or reversible compression. The lossy compression 
35 results in lost data. However, it should appear on a 
video display as nearly visually lossless. The los- 
sless compressed digital data is compressed much 
less than the lossy compression and allows res- 
toration of the image to its full original acquisitioned 
40 resolution. Lossy compression ratios are generally 
in the range of 1.5:1 to 4.0:1, whereas lossless 
compression ratios can be much higher, e. g., 12:1 
and up. 

As shown in Fig. 2. the recordable optical com- 
45 pact disk 10 is formatted to have the following 
regions: a handling zone 12 (which is empty); a 
leadout region 14; a region 16 for storing the file 
directory; a region 18 where losslessly compressed 
digital image data is stored; a region 20 where the 
so lossy compressed digital image data is stored; and 
a region 22 where header information is stored. 
Preferably, the header information contains the ap- 
propriate information to comply with ISO 9660 for- 
mats. The ISO 9660 compliance will enable mul- 
55 tiple computer platforms (IBM compatible PC's. 
Macintosh, Sun, and so forth) to recognize files on 
the CD. 
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The recordable optical compact disk or CD-R 
is a compact disk medium that can be recorded on 
once, but which, once recorded on. is not erasable. 
The compact disk may be recorded on in unrecor- 
ded regions at different times. The medium is 
compact, transportable, cost effective, and reliable. 

The recordable optical compact disk 10 of Fig. 
2 can be used in a digital archiving and review 
system alternative to 35mm cine film and asso- 
ciated equipment (cine cameras, processors and 
projectors). Although a cardiology imaging system 
will be described hereinafter, it will be understood 
that other medical imaging archiving and review 
system applications are contemplated for use with 
the recordable optical compact disk of the present 
invention. As shown in Fig. 1 , a cardiology motion 
image source 30 provides digital images to an 
archive station 32 where the images are recorded 
on one or more recordable optical compact disks 
10. The recordable optical CD 10 can then be 
viewed on a review station 34. 

Referring now to Fig. 3. there is shown a block 
diagram of an archive station 32 for receiving cardi- 
ology images and recording them on a recordable 
optical compact disk 10. As shown, archive station 
32 includes, a central processing unit (CPU) 35, 
internal memory 36. and a user input device linked 
to a bus 42. Bus 42 is linked to image pre-process- 
ing and compression board 48, and a buffer stor- 
age 52. Connected to bus 42 is an XEM (X-ray 
equipment manufacturer) motion image source in- 
terface 58, and a CD writer 60. CD writer 60 is a 
recordable optical disk writer, such as supplied by 
the Eastman Kodak Company, Rochester, New 
York, as the Kodak PCD Writer 600. The compres- 
sion board is preferably based on the Joint Photo- 
graphic Experts Group (JPEG) international digital 
image compression standard for continuous tone 
still images. A general overview of this standard is 
presented in the article entitled "The JPEG Still 
Picture Compression Standard", by Gregory K. 
Wallace, Communication of the ACM, April 1991. 
volume 4, No. 4, pages 30-44. It will be understood 
that other compression techniques can also be 
used within the scope of the present invention. 

The operation of archive station 32 is as fol- 
lows: 

In general, during the cardiac catheterization 
case study, the images are stored in the x-ray 
equipment manufacturer's (XEM's) digital acquisi- 
tion memory. The entire case's data will be trans- 
ferred to the archive station 32. Once data is stored 
in station 32, the XEM memory is free to acquire a 
new patient's images. The image data is received 
from the XEM memory by interface board 58. The 
image data is compressed two different ways in 
compression board 48: there is a lossy compres- 
sion and a lossless (for example, 2:1) compression. 



The lossy compression results in lost data. How- 
ever, it should appear as nearly visually lossless 
upon display. The 2:1 compression is lossless and 
allows restoration of the image to its full original 

5 acquisition resolution. The lossless and lossy com- 
pressed image data is stored in buffer storage 52. 
The user enters the patient's name. ID number, 
and so forth, into the archive station 32 by user 
input device 44, if this information cannot be sup- 

w plied via the XEM motion image source interface 
58. This information is merged with the image data 
and written by CD writer 60 to the CD 10. This 
feature allows the elimination of preparing the lead 
letters and the identification x-ray exposure. Part of 

is this information will be included in the header in- 
formation written to the CD 10 as well as the file 
directory of the CD 10 contents. 

A typical cardiology motion image source pro- 
duces 30 digital images per second. Each digital 

20 image can have a format of 512 x 512 pixel array, 
or a 1024 x 512 pixel array, with a pixel depth of 8 
bits. If a typical patient case study includes 2000 
images, a single Recordable CD can be used to 
record the case study (assuming lossy compres- 

25 sion of 10 + :1 and lossless compression of 2:1). 

Because of the probable need to accept new 
data from the user's lab while the previous patient's 
data has not been completely archived, buffer stor- 
* age 52 has the capacity to hold a minimum of two 

30 long patient study cases. 

Currently available 63 minute record once CDs 
10 have a maximum capacity of 540 Megabytes. 
The total capacity is not just data, but must include 
the data plus the ISO 9660 file structures, and so 

35 forth. Greater capacity record once CDs should be 
physically interchangeable with current record once 
CDs. 

If the cath case exceeds the capacity of a 
single CD 10, the lossy compressed track will 
40 contain the images of the entire case and is iden- 
tical on each CD 10. The lossless data is appro- 
priately split between the multiple CDs 10. 

Review Station 

45 

A review station 34 for displaying the images of 
a medical image study recorded on a recordable 
CD 10 is shown in Fig. 4. As shown, review station 
34 includes a user interface 90, a central process- 
so ing unit (CPU) 84, and memory 86 connected to 
bus 87. Also connected to bus 87 is an image 
decompression and post-processing board 92. and 
video display 96 by way of video controller 98. 
Review station 34 includes, a CD reader 100. and 
55 buffer storage 1 06 connected to bus 87. 

In general, review station 34 operates as fol- 
lows: A CD 10 is loaded into CD reader 100. 
Reader 100 produces sequential images of the 
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medical image study. The images are stored in 
buffer storage 106. Images which are read out of 
buffer storage 106 are decompressed and pro- 
cessed by board 92. The images are displayed on 
display 96 by way of video controller 98. 

Once the medical image case is stored onto 
CD 10 by archive station 32. it is available for 
immediate review on review station 34 (Fig. 4). The 
user selects through user interface 90 the desired 
CD 10 for viewing and the desired review mode. 
The reader 100 reads the CDs 10 data compres- 
sion format to determine the appropriate image 
decompression factors. The file directory is read 
from the CD 10 into memory 86 and the review 
station 34 is ready to begin displaying images on 
display 96. 

The need for palindrome capability (viewing 
motion both forward and reverse) has led to two 
operational modes for review station 34; one of 
which can offer full palindrome viewing if the sys- 
tem is restricted to utilizing the lossy data. Further- 
more, the user only has to load one of the poten- 
tially multiple CDs 10 used to archive the case, 
since each CD contains identical lossy compres- 
sion data of the entire case. The other mode will 
not provide reverse viewing, but will allow the user 
to back up and repeat viewing forward motion while 
maintaining the ability to access the lossless data 
for slow speed or still viewing. This mode of opera- 
tion will require the user to load all CDs 10 involved 
in archiving the case. 

Although the higher compression image data 
has lost data from the original image data, its 
compression will produce nearly visually lossless 
images. Cardiologists have consistently expressed 
a reluctance to wait for digital image records to be 
transferred and loaded into memory for real-time 
viewing. This concern is obviated by having the 
lossy compressed images available for real-time 
viewing (and also slow/still speeds depending upon 
the mode of operation) while the lossless images 
are available for detailed study of the images at 
slow or still speeds. The user can switch rapidly 
between any of the speeds: real-time, slow or still 
images. 

Review Station Modes of Operation 
MODE A 

If the user selects Mode A, only the lossy data 
will be utilized for any speed between still and real 
time motion. As the tossy compressed data is read 
from the CD 10 it is loaded into the buffer storage 
106 which will act as a buffer to compensate for 
the variable amount of compressed data on a 
frame to frame basis. After a suitable amount of 
data has been buffered that will allow sustained 



display rates, the data is sent to the decompres- 
sion board 92 for image display on display 96. 
When the user switches to reverse viewing, the 
compressed data will be read in "reverse" from 
5 buffer storage 106 and sent to the decompression 
board 92 for processing. Via either data direction 
path, the decompressed data is then processed for 
display 96. 

w MODE B 

If the user selects Mode B, both the lossy and 
lossless data will be utilized for image display on 
display 96. Obviously, if the patient case was ar- 

15 chived with multiple CDs 10, potentially the user 
must load all the cases CDs 10. The lossy data wilt 
be used for viewing images in forward motion at 
speeds > the threshold speed through realtime 
motion. For images viewed still, single advance or 

20 less than the threshold speed, the lossless data will 
be obtained from the CD 10 for decompression by 
decompression board 92. The threshold speed is a 
function of the data transfer rate of the CD reader 
100 used and the amount of data per image. The 

25 amount of data per image is primarily a function of 
the data acquisition/archive matrix. 

Since the user can interactively switch between 
the lossy and lossless data, the scheme of loading 
the compressed data into buffer storage 106 and 

30 reading it in reverse will not work as the reverse 
viewing of the lossy/lossless data image mixture 
would not permit sustained viewing speeds and this 
would be very annoying to the user. Therefore, true 
palindrome viewing cannot be provided when op- 

35 erating in this mode. To repeat viewing a sequence 
of images, the user may "jump back" a specific 
number of images and once again view images in 
forward motion. Depending upon frames to be 
viewed and the speed selected for reverse viewing 

ao of images, the user may experience a time delay 
as the appropriate data (lossy or lossless) may 
have to be first read off the CD 10. In Mode B, 
motion is limited to the forward direction only. 

Review station 34 can also be used according 

45 to the present invention, to read lossless com- 
pressed medical image data from a CD-R that only 
has recorded thereon such data, and create lossy 
compression data from it and store it on a relatively 
fast and inexpensive medium such as a hard disk 

so in memory 86 or buffer storage 106. The lossy 
compressed medical image data can then be used 
to provide real time motion viewing of the images 
on display 96. 

The invention can also be used with other 
55 computer based equipment. This will be described 
with reference to Fig. 5. As shown, a digital ex- 
change medium 100 (such as a CD-R or the tike), 
is loaded in exchange medium reader 102 which 
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reads the losslessly compressed medical image 
data from medium 100 and passes it to computer 
based system 104. System 104 decompresses the 
lossless medical image data at circuit 106. lossy 
compresses the data from circuit 106 at circuit 108. 
stores the lossy compressed medical image data in 
inexpensive magnetic hard drive 110, and displays 
the medical images on display 114 after the lossy 
compressed medical image data from drive 110 is 
decompressed at circuit 112. Optionally, the lossy 
compressed medical image data from drive 110 
can be recorded by writer 116 on the original 
digital medium 100 or on a new digital medium 
100'. 

A common digital acquisition matrix for x-ray 
angiography is 1024 x 512 x 8 bits at 30 images 
per second or approximately 0.5 Megabyte (MB) 
each at 15 Megabytes per second. A lossless 
compression of this data is typically a 2:1 reduction 
in the amount of data. To read this data from the 
storage medium would require data rates of at least 
7.5 MB/sec. Common inexpensive exchange media 
has data transfer rates of approximately 1 MB/sec. 
or less. Therefore, in order to view the images at 
real time motion rates, the digital data must be 
transferred to very fast buffer storage such as an 
expensive disk array. The present invention pro- 
vides real time motion display of the images with- 
out an expensive disk array in the same amount of 
time it takes to upload the data to the disk array. 

As the losslessly compressed data are trans- 
ferred from the digital exchange medium reader to 
the computer based system, the data are losslessly 
decompressed. A lossy compression of the image 
data is then performed which will support real time 
motion image display. The lossy image data is 
temporarily stored on an inexpensive magnetic 
hard drive. Once the data has been transferred 
from the exchange medium, decompressed and 
recompressed, it is available for conversion to soft 
display. 

Once the real time compressed data is avail- 
able on the temporary hard drive storage, it could 
also be subsequently added to the original ex- 
change medium or written onto a new exchange 
medium for future use. 

Although the described system has been de- 
scribed specifically in relation to the archive and 
review of cardiology images produced during a 
catheterization study of a patient by angiography x- 
ray imaging, it will be understood that the de- 
scribed invention includes other types of medical 
images in both lossy compressed and losslessly 
compressed image data. Thus, the medical images 
can be from any number of diagnostic imaging 
modalities (such as. MRI. US. CT. PET, NM, and 
so forth); digital radiography (such as storage phos- 
phor systems); still and cine radiographic film 



digitizers: and the like. 
Claims 

5 1. A method of displaying in real time motion 
medical images recorded on a transportable 
medium (100) as lossless compressed medical 
image data, comprising: 

reading (102) lossless compressed medi- 
w cal image data from a transportable medium 

(100) upon which it is recorded; 

decompressing (106) the lossless com- 
pressed medical image data to produce de- 
compressed medical image data; 
is lossy compressing (108) the decom- 

pressed medical image data to produce lossy 
compressed medical image data; 

storing the lossy compressed medical im- 
age data on an inexpensive magnetic hard 
20 drive (110); and 

displaying the medical images represented 
by the lossy compressed medical images in 
real time motion on a display (114). 

25 2. The method of claim 1 including the step of 
recording (116) the lossy compressed medical 
image data on the the transportable medium 
(100) from which the corresponding lossless 
compressed medical image data were read. 

30 

3. The method of claim 1 including the step of 
recording (116) the lossy compressed medical 
image data on a transportable medium (100) 
other than the transportable medium (100) 
35 from which the corresponding lossless com- 

pressed medical image data were read. 
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